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introduction ' : 

H , . ■ ■• 

The Comprehensive School Mathematics Program is a K-6 mathesnatics 
curriculum developed by CEMREE, » °^ ^he regional educational 

laboratories funded by the Nationai institute for Education through 1982. 
Fihal^prbductibh of materials and summary evaluation reports were, completed by 
McREL^ another of the NIE educational regional laboratories. 

. f . _ _ _ 

During the development and pilot testing of this cbrricditffn , an extensive 
evaluation wa^ conducted by ah evaluation staff independent of the program 
developers and guided by ah external Evaluation Panel. The work took place 
over a period of ninie yiears in cbbperatibh with apprbximately 4D school 
districts at one time or another. 



This report is essentially a "map" of ^ the available evaluation reports^ 
together with a very brief summary of each. The best single summary report ^ 
integrating all previous reports, will be completed and available from NIE in 
December, 1983. 
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Classif icatibh of Reports 

The two tabids on the next pages classifyi reports ifrom a) the Evaluation 
Reports v^iich describe genersil evaluation studies conducted by BEMREt's 
Mathematics Research and Evaluation Studies group (MRES) and b) Eooperative 
Research Studies, reports of evaluation studies conducted jointly by 
cooperating school districts and MRES. 

>^ reports themselves are listed along the left margin of the tables. 
The varipus- subject matters of these reports are listed across the top. , Then 
in the table are numbers (or in some cases a range of numbers). Each number 
(or range) indicates (a) the existence of a report given directly to its left 
in the margin, (b) the subject matter of that report (given directly above it 
^ the top) (c) the grade level(s) of the student and/or teachers involved. 



Some of the numbers are circled. This signifies that the indicated report 
covers the school year when the major evaluation effort was being made at that 
grade level. Thus an uncircled number signifies that \he report covers a time 
when the major evaluation effort was fdcUsed on another grade level. 

Hence if one wished (for instance) to read the report oh the maior 
findings relative to standardtEed tests at the third grade livel, one would 
first locate that subject at the top and then read directly below it until 
reaching a circled 3. To the left of that (3) would be the report of interest 
(in this instance 4-B-1 ) . 
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Description -of Cooperative Research Studies 



Grade Type of Gifted (G) or Number of 
, Level CbmmUhity Regular (R) i; Classes Tested 



2 - 
2 

5-4 



Bedford, 81 
Detroit, 81 - 
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Small City G 
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Small City G 
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4 
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je^ 
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R ■ 
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> 




;63 
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Ann Arbor, 8^2 
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Small City 


R 
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Globe^-^ 82 


2 


Small City 
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^ 69 
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Suburban 
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G ^ 




15 




71 



. - ' .3-9 

o 

ERIC 



Evaluatibh Report 

_ _ . _ " '- ft 

Overview, Deadgri and Ifiipleiriehtation ^ 

' . 1974 , • V • 

The^jpurpose of tF)is report is three-fold. First, a description is given of- 

CSMP, bot^ as a development project and as a product, ie. as a mathanatics 

- * ', , " 

curriculun. Second, the goals of the evaluation and the'kinds of questions it * 

is intended to answer are described. Third^ the design of the pilot trial and 

-the particjjlar data and ihstroments used to collect that data during tfjie -first 

- ___ ■•, ■ ■ ^ 

year of the pilot trial are given. : 

" - • , 

Thus this report is intended to be a background report describing -^e 
general nature of the program and t^he way in which the evaluatian is beiftg 
carried out rather than a presentation of any aCtaai results. Report 1-A-3 
gives a sunmary of the results from the first year; the other reports provide 
data attending to particular issues. Hopefully the present report will serve as 
an "organizer" for ttie many evaluatibh reports of this series J 
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Evaluation Report i-A-2 
External Review of CSMP Materials ' » 

. 1974 ' - ' " 

In order to have the sSandne^s and relevance of the program appraised, the 

program agreed to the selection of an independent set of math edacation experts 

for the purpose reviewing the materials, ,In the field of mathematics 

education, and one suspebts within any academic discipline, there is a wide 

divergence of bpihibri as tb what pedagogy should be used to teach what content 

- - - - X 

tb school children.' Therefbre the prbgram is tb be commended for wholeheartedly 



cooperating in ah enterprise which' it could avbid arid wtiich could fDrbduce rather 
ecnbarassirig results. 

Five persons wiere selected: 



Professor Shirley Hill 

University of Missouri at Kansas City 

Professor ban E. Christie 
Bowdoin College - ^ 

Professor t'goriard Giiiman 
University of Texas at Austin 

Professor George Springer 
Indiana University 

• ■ 

Prbfessbr Sherman Steiri 
Uriiv6rsity bf Califbrriia at Davis 



Or. Shipley Hill agreed tb serve as cHairmari bf the grdUp ah to summarize the 
set of reviews; 



^This report gives each expert's review verbatim in addition to Dr. Hill's 
summary; 



; , Evaruatibri Report 

Final Sunwnary Report Year 1 ^ 
' - / 1974 

_/jhe present report. Is an attempt tb surnmarize. in i reasonably hbh- 
technical way, tRe information collected during this first year of CSMP'g 
Extended Pilot Test. While it is next possible, rtor necessarily desirable, to 
suppress the opih^ons and prejudice^ of the evaluator, one hopes ^the reader can 
easily separafce^e presentation of data from the author's interpretation of 
those data.,^n any case, if the reader wishes more informaiion about certain of 
the data reported here or_j?ould like tb see the actual tests or questionnaires' 
or instruments used, he or s^e may consult the apfDropri^te report in this 
Evaluation Report Series. 
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Evaluation Report 1-B-1 * 
Mid-Year Test Data: CSMP First Grade Content 

1974 

The puriDose of this report is to describe the results of a test admin- 

_ - - _ - _- _"~ _'_ ~ 

istered tb'lbcal first grade classes approximately half-way through the school 
% . 

year. The test covered^ with one exception^ those specific topics of the CSMP 
curriculum for which students should have been at or near" what might be called a 
"mastery" level:/ 




r(Bla\idhd , multiplicatidh , hUmber-hLineral , 
addition , minicomputer , order 

In the authors' opinion the levels of attainment were reasonable. Since 
there was no comparison group, no more definitive statement could be made, 

A comparison group was impractical due to the impossibility of eliminating 



specific CSMP content from the tests. 
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' Evaluatidh Report 1-B-2 
End'Of-Year Test Data: CSHP First Grade Cbriterit 
' . ' ^ 1974 

— ' - ^ 

The purpose of this report is to describe the results of the erid-bf-year 
test of CSMP content administered to 14 local first grade classes in May of 
1974. The test fwith its 12 sabtests) generally covered those specific topics 
of the CSMP curriculum for which there were clearly defined tasks that students 
should have been able to do, "'^ 

Judgments of thi\^ adequacy of the eSMP students' performance (very gbbd^ 
adequate, inadequate, very poor) /on the end-of-year test are not made in 

comparison to the math perfbrmahces of classes from past years, or in comparison 

__ _ ^ _ — 

to Non-CSMP classes in the study. Judgments have been made relative to CSMP ^ 
^tadents* performance on tyjDes of prbblwiis which frequently appear in the first 
grade program, particularly in the wbrkbooks. In most c^ses the sane language 
^ancf formatting have been used' in the test as in the workbooks. 



While there is some variation across subtests in the judgments regarding 

b'^ ^ ___ _ __ . 

adequacy of student performance, the top two quarters of students were almost 

always rated as very good. The third quarter was most often rated as adequate 
and the bbttbm qUarter as inadequate. 



The large discrepancy in performance between the highest and lowest scoring 
stadents was examined in light of jDerfbrmance on the Test of Standard Content* 
(See Report where^ there were alsb large differences between high and low 

scoring students, it was found that those differences occurred consistently and 
to the same degree in CSMP and ^^^in-CSMP classes. 

-11- ( 
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Evalaation Report 1-B-3 
Ehd-of-Year list Data: Standard First Grade Content 
. 1974. 

V - - - . ' . ' ' . 

This report deals with the question; "Gan eSMP stadents, after completing 
first grade, demonstrate the arithmetic skills and knowledge of the concepts 
traditionally expected from first grade students?" 

i ■ - - 
Sixteen teachers in five school districts of the metropolitan St. touis 

area, after attending a dne^week traihirig sessibh^ taught the CSMP carricaiom to 

their first grade students. For each CSMP class^ a cdmparisdh class was 

designated. 



Based on an analysis of leading texts, a series of seven tests was con- 
structed. An eighth test dealt with larger numbers. - 



A comparison of the ESMP versus Non-CSMP classes revealed the fdl lowing: 

/ 



a) CSMP classes scored significantly hi^er on. Test 8: Larger Numbers, 

b) CSMP classes scored higher oh Place Value and Measurement, 

S 

c) ISIon-CSMP classes scored higher on Subtractibhj 

d) There were no differences on the other tests: 

■_- - _ _ _ •_ 

Nuoygratibh, Addition, Order, and Application. 



( -12- 



\ 



- Evaluation Report 
Ehd-bf-rear Test Data: eSMP Kindergarten Content 

1974 

While the primary evaluative anphasia in 1973-74 was on first grade 
classes, some data was gathered from local kindergarten classes as well, 

A test measuring the objectives of the CSMP kindergarten curriculum was 
constructed and administered to some local CSHP kindergarten classes and to some, 
comparison kindergarten classes in' May, 1974. This report describes that test; 

its construction and the results. 

- :' ^ ) -) . 

The test consisted of 12 subtests, nine of which covered topics nofmaiiy 
covered in Kindergarten while three covered topics UhiqUe to CSMP. ^ 

In summary, the CSMP students appear to have "mastered" the objectives 
represented by the twelve subtests with the exception of objectives 9 and ID 
dealing with arrow diagrams and scored as high as or higher than Ndh-CSMP 
students oa all subtests. 
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Evaluation Report i-B-5 
' : Test Data on Sat^e General Cognitive Skills 

1974 

V - • 

Three types of student outcomes ^ere studies during 1973-74 at the first 
grade level : 

a) Student achievement of the content' of the eSMP program, 



b) Student achievement of the standard skills and concepts generally 
exfjected in mathematics and 

c) Long range effects bo students* ability to "think mathematically." 

Of course "thinking mathematically" conveys very little to the reader until 
some more detailed expilahatibh of the task is given. What is intended by c) is 
the issue of whether or hot CSMP students can do 'better than Non-CSMP students 
at certain tasks which are hot depishdeht on the uhique cbhteht of the CSMP 
program for their solution. They are in a sehse cbhteht-free ahd can thus be 
considered one form of transfer, task. 



Three such content-free tests were constructed and administered on an 

' '■ . 

individual basis to first grade students from ESMP and comparison classes, from 
four to six pairs of classes for, each test. 



CSMP classes had higher mean scores than comparison classes on all three 

_«_ _ _ _ 

tests, but this differehce did hbt reach the .05 level bf significance oh any of 

them. Thus the evidence is at best "suggestive," and rather strbhgly sb fbr 

Tests 2 and 3, of superior performance by CSMP students. 
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I Evaluatidn Report 

Sammary Test Data: Detroit Schools 
"1974' ' ' 

This report hot only^provides .information regarding the success of the ' 
program in Detroit, but also aH^s the comparison of results obtained locally 
with thoss from a rather different pilot site. ; - 

One- might summarize the test data by saying that CSMP classes did very well 
comparted to NonTCSMP classes on tests of stindard' content and general cognitive 
skills. They also did reasonably well on the eSMP tests j^^ne takes into ■ . 
^^^Q""*^ ^he rather meager progress of five of these- classes. Of the twenty-six 
other first grade teachers, some withk. low ability ciass^sT^;^ responded to the 
end-of-year questionnaire, only fbUr covered fewer than 200 lesions, yet five of 
, the seven Detroit classes did not complete as many as the first 150 lessons. 




Evaluatibh Report 1-C-3 
Hid- Year Data fxom Teacher Quest idririai res 
. 1974 

In Oanuary a questibhhaire was sent to all kindergarten and first grade 
tiiachers in the CSMP Extended Pilot Trial*. Severity-hihe percent of the 
questionnaires were completed and returned to CEMRELj 



in summary , teachers had few difficulties in presenting the topics^ students 

_ _ _ _ _ __ _. __, 

liked the topics a great deal , and while respdnsies wieriB generally favorable 

^ 

"Ffegarding difficulty for students, some content areas were perceivied as being 




rather difficult. 
1^ 



A^ked to rate various components of the program^ most items drew very 
vfavorable responses; _ ^ 

Asked about the overall worth of the program, most teachers thought that 
CSMP students were far more involved and that the overall quality of the program 
-was higher than was their previous math^efiiatics prbgr^. j 

There were, however, three arisas of moderate dissatisfaction: 

1) The adequacy of the program and the rapidity of the pace for low 
ability students. ' > 

2) the management *^f instructional materials and 

3) Student difficulties in one or two areas of content. ^ 
The responses to these issues can perhaps best be categorized as neutral 
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to slightly negative. Oh the other hand for the vast majority of items 

- - / ' 'l . 

responses wier^ very favorably. ^^^^ 

.." , : =16= IB 



Evaluation Report 1-C-t 
Teacher Trai*hihg Report 
; 1974 

; This report describes the 5 workshops cdhducted duririg the summer of: 1973 
to prepare teachers and coordinators for the implement at ibr^pf the program: .the 
instructional materials, the workshops format and the math content covered. 

In addition it presents the data collected from the 69 workshop 
participants with a background* questionnaire, a reaction quest idhhaire and a 
post test of content covered • 



Evaluatidri Report 1-E-2 
Observations of CSMP First Grade Glasses 

1974 



The purpose of thisi report is to describe the bbservations carried oat in 
14 of the local first grade classes. In the first section, the .parpose and 
design of the dbservatidhs are spelled but. Subsequent sections present the 
results of the observations including descriptions of the classes, the obser-- 
vation form used, and Implicatidhs' for the program. 

On the basis of the observatidhs the^ fdlldwihg cbhclusidhs were drawn. 

1. In general , most of the teachers we observed implemented the program in 
an acceptable manner; 

2. The program appeared to vary as the makeup of the classes and teacher ^ 
styles varied. ' 

3. The program seemed quite adaptable to di ffering classroom situations. 

4. Teacher attitudes were generally quite positive toward the progi^m 
throughout the year. 

V 

5. The students in the classes appeared able td perfdrm in a reasonable 

0 

fashion during the lessons. 
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Evaluation Report l-G-A 
End-bfrYear Data from Teacher Qa^stionnaires^ 
u ' - - 1974 

i 

This report describes' the responses of participating teachers to a 
questionnaire mailed during the first week of June 1974. 

Altogether 67 of the 1 16 end^df^'yeSr questionnaires were completed and 
returned, a 58% retarn rate. 



The questionnaire 'was intended to elicit teachers' reactions to various 
aspects of the CSMP contfent, their reactions to the instructional materials, and 
their overall judgments, both comparative and absolute; regarding the worthiness 
of the prog ran. 



The fdllbwihg pdhclusiohs were drawn from the data. 

1. Generally teachers responded favorably towards CSMP. 



2.. Where questions were* repeated frbm a questionnafre given earlier in the 
year, responses t^ded to be similar to of slightly more positive than 
responses given at that time. 

3. Teachers who w^re trained by CSMP persbnnel in one-week workshops res- 
ponded more positively to several questions than did teachers who were 

trained by their coordinators. 

» ^ - ' - 

4. Certain criticisms of the program were m^de by sbme teachers. One 
major one dealt with the slow iearper problem. The secbnd major crit- 
icism dealt with* the large, amoant of material in the first grade. 
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^ Evaiaation Report i-C-5 
Interviews with. ESMP kindergarten Teachers 

1974 



The purpose of this report is to describe observations and interviews 
conducted in the local kindergarte'n classes ''daring the last month of the school 
year of 1973-74. 

From all the questions asked and all the responses given in the interview a 
number of cdhclusidhs were drawn. « - 

s • ■ . 

i. 

These conclusions leave one with ah bverwhelmihg impression that the 
teachers regard the program in a highly favorable light. The only problems 
identified with some consistency were the program's ihapprbpr lateness for the 
very slow learner, the disorganization and lack of explicithisss of "the gUide^ 
and the need for more emphasis on elementary counting and number concepts at the, 
beginning of the qourse. Even these views were held by only some of the 
teachers. H • 



r 
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Evaluation Report 1-G-6 
Analysis oF Teacher bogs 

Daring the school year 1973-74, each first grade and kindergarten teacher 
was requested to keep q weekly ^dg, recording for each day, th^pentification 
^mber (or natne^T :of the lessjin, the time taken to teach the "lesson, and a rating 
"good," "fair," or "poor" for each lesson taught. They were also asked for. 
ttieir reactione to individaal lessons and the program in gefSferal. 



In the .first grade, all of the responding teachers thought most of the 
lessons were good, with the outer ring teachers tending to rat> the lessons 
higher. than the local teachers . ; Even thoQgh the mean reported time Tor teaching 
each lesson was generally in agreement with the time recommended by the progran, 
most of the teaplw-s-were not able to reach lesson A24Q which was the minimum 
expectation for H^tem. The reactions of both tfie local and outer ring, teachers 
to individual lessons were mostly favorable and giS^but one of the reported • 
anecdotes were also favorable to the program. 

hike the first grade teachers, all of the 'responding kindergarten teachers 
thought most of the lessons were gdod with hd apparent differences in the 
ratings betweecLthe local and outer ring teachers. Trie average'it'i^ teach ;a 
lesson was about 21 minutes. The reactions of, both the local ahd outer ring 
teachers to individual lessons and the ^program4n general were fjSvbrable ahd all 
but one of the reported anecdptes were also favorable to the program. 
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Evaluation Report 2-A-1 
Final Summary Report tear 2 
1975 

in the fall of 19^3, the Cdmprehehsive School Mathematics Program (ESMP) 
began a longitudinal pilot study of its Elertlehtary Program. Over 100 teachers 
began using the program, either in first grade or kindergarten. During the 
19:74"75 school year, the second year of this pilot- study, most of these classes 
continued into second grade and first grade respectiviely arid many riew classes 
began using GSMP materials. 

* ' ' ■ ' 

The present report is an attempt to summarize, in a a reasonably 
ribri-techriical way, the information coiiected during the second year. While it 
is riot possible, ribr necessarily desirable^ to suppress the opinions and 
prejudices of the evaluatbr^ grie hopes the reader can easily separate the 
preseritatidri of data from the authors' interpretation of those data, in any 
case, if the reader wishes more irifbrmatibri about certain of the data reported 
here or would like t^d see the actual tests br questibnriaires or instruments 
used, he or she many consult the ^Appropriate rejDbrt iri this EvalUatibn Report 
Series. V 



^EvdluatiDh Report 2-8^1 

V . -- - - - ' 

Second Grad^ - Test Data 



. - 1975 



Thirteen: second grade classes in fSur districts in the local area studied 



the CSMP curriculum during the 1974-7| school ^ear. A wide range of ability 
and sobib-ecbriomic status Was represented by these classes. Fbr each CSMP class 
there was a cbmparisbh class, in the same school where popible. These classes^ 
were usually the sane groups oT students who were tested the year before in 
first grade in the CSMP-Noh^pS«P comparisons described in Evaluation Report 

In the fall a test of mental ebilities was administered to all students 
and the scores frdm this test wer^ used as covariates in the subsequent analysis 

-between CSMP and Non-CSMP classes. Because of the rather careful pairing of 

classes such difference were generally quite small. 



In sunmafy, eSMP classes did better than Klbh-CSHP classes on both 
standardized measures and some "conteht^f ree" cbmjDarisoh tasks ancJ this is true 
for both high and Icjw^^bi'iit y students and for both brigihal and transfer 
students. Afthouglj/overall performance was generally adequate ^nd at times 
praiseworthy fbr unique CSMP content, on those subtests involving arrow diagrams 
and the Minicomputer a considerable number of students had little or hd success, 
and students who transferred into CSMP classes near the beginning of the year 
were not eble tb catch Up with their classmates^ on eSMP concepts^ 



Evaluation Report 2-B-2 
Readministratldn of. First Grade Test Items 
- V 1975 

_The major purpose of this report is to compare the perfdnhahce of two 
groups of first grade eSMP students; the teachers of the first group were hew to 
CSMP and the teachers of the second group were the same teachers one year later. 
A lower perfbrmahce the second year would support the contention that results 
obtained in the first year of the pilot study, 1973-74, were at least partly due 
to the enthusiasm of the teachers for a novel math program. A higher 
jDerformahce would support the view that teachers the second time around more 
than made up for any loss of enthusiasm because they were more familiar with the 
program. 

In summary, it appears that CSMP teachers do Ju^t as well the second time 
around and that any loss due. to the novelty effect of the program is more than 
balanced by the gain in experience. This is in agreement with statements made by 
these same teachers in a series of interviews conducted at the end of the school 
year (see Evaluation ^Report f-C-S). In addition the data tends to corroborate 
the findings from last year and to cast some doubt on the possibility that in 
some cases CSMP students did better because they had better teachers. While the 
results are riot strong eridugh to support a definite conclusion they tend to give 
additibrial credence to the results from last year- 
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Evaluatibh Report 2-B-3 
Student Interviews 
1975 



During this second pilot study year, a series of interviews was conducted 
with 18 second grade students. 



The purpose of these ihte^iews was ^ in\?estigate how children thought 
about and Understood CSMP math. U the end of this section a brief 
summarization of some of the WstfSHt areas is given, but this barely scratches 
the surface of the available information. Certainly a number of issues might be 
raised and conjectures made, but the reader will h^ve to do that himself, and 
one saspects there might be considerable disagreement among different readers. 

The interviews yielded disappbihtingly little infBrmation about how these 
students felt about CSMP. While these students seemed to like their math, they 
did not volunteer much regarding their reasons. Many responses were rather un- 
enthusiastic, one-word answers, although they were usually rather chatty about 
other tfhihgs, such as what, they did over the week-end, and they seemed to enjoy 
the interviews and showing what they could do. Perhaps this is not surprising. 
Af te,r all this was their regular math program - the same one they had had 
since beginning first grade - certainly^ nothing experimental or hew. 
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Evaluation Report 2-C-1 



Teacher Questionnaire Data 



1975 



In the spring of 1975, a questidhnaire was sent to all teachers using the 

# _ _ _ ~ _ _ 
CSMP curriculum either at the kindergarten, first, or • second grade levels. Some 

of these teachers had taught CSMP the previous year (1973-74) and were 

classified as "Experienced" teachers. About 5bS of the questionnaires were 



1. The clearest^ most unequivocal responses (favorable) were given in 
answer to questions concerning student attitude. 

2. Teachers feit that students' achievement was higher with CSMP than 
'compared to previous years with other math programs. 

3. There were many signs that the progran appeared to be being implemen- 
ted fairly well. 

, 4. However^ there were things happening which were not intended: three 
quarteri of the_teachers supplementihg the progran with Nbri-CSMP 
material J significant _humbers of teachers spending more time with 
math; Tdrty percent of the teachers rfceivihg less than half the 
, amount of teacher training; and many second and third_grade teachers 
hot completing even the mihimum recommended portibh of the curriculum. 

In the author's dpinion the two most danaging criticisms had td dd with the 
(possibly related) issues of the efficacy df the Minicomputer and the apprdpri- 
ateness of the progran for low ability students. 37!S of the firsthand second 
grade teachers did not think the Minicomputer was a good device for teaching low 
ability students. Forty-one percent of the teachers thought CSMP less appropri- 
ate for low ability students than their previous math prog^^. 



. returned. 



L 




Evaiaation Report 2-C-2 
Teacher interviews, Second Grade 
1975 



This report describes the interviews conducted with the 18 local second 
grade teachers at the end oF the school year. These were teachers of classes 
which began using CSMP materials In first grade t|e* previous year. Hence the 



students had completed two years of the CSMP program. 



One is left with an overwhelming impression that the teachers have a very 
high regard for the program. The only probl^s mentioned with any consistency 
were the difficulties experienced by the slower students f and the need for more 
emphasis on the basic addition and subtraction facts. 



/ 



V 
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Evaluatibri Report 2-C-3 
Teacher Interviews, First Grade 
1975 

This report describes the interviews cdnducted with 13 local first grade 
teachers at the end of the school year. These teachers all taught first grade 
ESMP during the previous year, 1973-74; they were the lead group of first grade 
teachers. Thus this was their second year in teaching the first grade CSM^ 
curriculum; 

S 

1. Five teachers were from districts jthat will not be teaching ESMP 
• next year. This may have caused them to respond or to teach the 

program in a different way than would be the case if they knew their 
students would be cbritiriuirig into second grade in ESMP. 

2. There was generally what might be called a ''return to ribrmality''. Teachers 
were neither wildly enthusiastic nor extremely negative in their 
appraisals of various asjDects of the program. 

3. They were getting used to the (Drogran and had indeed ihcbrpbrated it iritb 
their teaching so that ESHP was rip longer "the riew math jDrbgram" but was 
becdmihgi in a aerise, just plairi"math". 

4. Without doubt the teachers like the program arid like teachirig it.i 



5. The most positive aspect of ESMP was the erithusiasm that stUderits tiad for 
the program. 



6. The questions which drew the longest responses and the most disagreement 
^^^^^.^f^^^.^^S^^^^'L^Q the appropriateness of the progran for low ability* 
students and the value of the Minicomputer bs a teaching device. 



Evaluatibri Report 3-8-1 
Second arid Third Grade Test ^ta y,ear ?• 



This report summarizes t^at data cbllected from second the 'third, grade ' 
classes daring 1975-76, the third year of the CSHP Extended Pilot tcstv ^ . / , 
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Briefly one can summarize the results as follows: 



a) ^standardized mathematics tests, CSMP classes generally did as w6li 

as or better, than Non-CSMP classes. At third grade the differences 

were significant on Both tests of the CTBS. At second grSde the resaiti 

were more equivocal; ,not reaching significance at any of the four sites, 

but usually ir^ favor of CSMP, especially on the tests of computational 

skills. Similar resdlts have occurred in previous years; small differ- 
_ _ _ ' . ' . ■ \ 

ehces in favor of CSMP students which sometimes reached sighificar^e 

and sometimes did hot. 

. ■ ■ X.- ■ 

b) On the MANS tests, CSMP classes scored significantly higher than Ndh- 
eSMP classes on both total MANS scores and on three of the subtests, 
and were close to significantly higher (p<.1Q) on three other subtests. 
Again tf^s pattern is rather similar to results from previods years: 
consistently hi9her socres by CSMP classes in all subtests with signif- 



icance reached on certain subtests and oh the overall, totals: 
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Evaluation Report 3-C-1 
teacher (Juestidnnaire Data Year 3 
1976 



□rie handred foarteen quest ionna¥?fes were distributed to CSMP teachers at 



the second and third grade levels. Fifty-four percent did hot return the 
questionnaires, and the findings reported herein are therfore based dh A6% of 
the teacher sample. For the purpose of summarizing the data,- second the third 
grade teacher respbrises\ are combined. 



In ah overall evaluation of ESMP, 9Q% of the resulting responses were 

judged positive. Over half indicated their students attitudes^oward math 

^% - . ; ^ 

were "better" or '.'much better" with CSMP. Also, over half the teachers Felt 

__ ^ 
that they did "better" or "much better" in math with CSMP than they would have 

yii^h another program. But, seventy-six (Derceht of the respbriderits indicated 

they would like CSMP to provide them with a means of evaluating their students* ; 

> ____ ' _ ___ _ __ _ ._ 

.progress, with th|r majority of teachers suggesting that tests be «npldyed for 

this purpose. 

. : , 

«. Three-qaarters of the teachers supplemented the prograiS with Ndri-CSMP 

; ■ 4 

material such as. commercial worksheets; a figure comparable to: that from 
previous questibririaires in lower grade ievei^; When asked to respond in a, free 
^response sytle to the questiSn: "What is your opinion of the spiral approac^i^s 
Used in CSMP?" 58S of the resulting responses were judged to be positive. The 
majority of teachers were happy with the style bf classrbbm mariagesmeht proposed 
hy CSMP. .- .• 

r . 
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Evaluation R^pot>t 
Final Summary Rep^pt Vear 4 
1977 

This rep5rt saiijfijarized the data collected during this fourth year of the 
Extended Pilot Trial, in which the evaluation Focussed on third grade students 

/ * 

and teachers. Foar separate, evaluaticai reports describe in more detail the data 
sumr^arized here: 

4-B-1 Standardized Test Data, Third Grade 



4-B-2 . Mathematics Applied to Novel Situatibr2§^ 



(MANS) Test Data 



4^-3 ^Individually Administered Problsiis, 
Third Grade ' ^ 

4-C-1 Teachet Questionnaire Data, Third Grade 



i 



Evaluation Report . 
Standardized Test Data^ Third Grade 
1977 

Throughout the Extended Pilot Trials standardized tests have been used to 
compare CSMP and Non-CSMP students' perfbrmahce dh these traditional skills arid 
concepts. j This report describes the results of three such studies irivblvirig 
veteran CSMP third ^ade classes. These studies were carried out in three of 
the largest CSMP third grade sites which contained, between them, 33 of the 8B 
veteran ESMP classes of 1976-77. 



In summary then, CSMP students at the end of third grade appear to be 

developing satisfactory computational skill. At one site, however, there is 

eviderice that they do riot do well ori the "concepiEs" items of the CTBS, 

particularly those dealing^ with sets and ritwnber aentericesi 
# ■ : ; - 
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Evaiuatidn Report 4-B-2 
Mathematics Applied to Novel Situations (.MANS) Test Data 

1977 

In the evaiuatidn- of CSMP atadent achieveweht , two major questions hive 
been asked. The first: Do studenta learrr the basic concepts and skills, 
particularly computational skills, generally expected of students in el«nentary 
school? Standardized math achiev^ent tests are used to gather data in answer 
to this question (Evaiuatidn Report 4-B-1). 

_ \ - ^7 

The second major questidri is: Are C^MP students, particularly^4fter two or 
three years in the program, better able to deal with certain kindsldf (hovel) 
mathematical situations than are studenti who have hot studied CSMP? A inajdr • 
study was carried out involving many classes of studen^ from several CSMP sites 
wHd were tested with a specially develdped series of tests called Mathematics 
Applied td Novel Situations (MANS).**^ • 

Oh tfie tests of Mathematics Applied to Novel Situations there is consid- 
erable evidence td indicate that classes of students whj) have used the CSMP 
curriculum for at least three years score better than Classes df students who 
have not. The finding hdlds Tor the classes in general, for classes at differ- 
eht ability levels, and for classes in all three sites tested (but dniy signif- 
icantly so in two of the three sites). It is also clear that this finding holds 
at each ability level of the students tested*and for both boys and girls. A 'j 
large Appendix (A) to this report is deVdted to a thorough disajssion of the 
prdcess whereby the MANS Scales were deVeldped. 
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Evaiuatidn Report 4^B-3 

Vv. 



Individually Administjered Problems, Third Gradei ^ 

1977 



. i J , ^ . 

Tfrls report describd^ the results of some individually conducted tests with 



third graders in the St^ tddia region. The purpose of ttJ^s task was to get a 

deeper uriderstaridirig of the: mathematical processes used by ESMP versus Non-ESMP 

- _ ^ ■ _ Vv 

students than paper arid pericil allow. A greafc deal of information - the process 

- - _- • -'• --_ - - - " ^ ' . 

of develbpmerit^ the complexity of the eyeritual format and the mass of student 

resjDorises - has been summarized very b|ij.efly iri^this i'eporti This study is 

exploratory arid will cbritiriue^ in brie Form or aribther^ in higher grades. 



4 



In summary, there are very real differences iri favbr of CSHP studerits bri a 
relatively small number of items. There is some evidence that above average 
CSMP students are better able to quickly check complete calculations; that CSMP 
students give ffewer but better explanation for these calculatidhs; that CSMP 
students are rather better at relating multiplication to division and addition; 
/and that ESMP students are better able to "solve" a secret rule when required to 
choose the objects to be tested. For most of the other tasks however, the 



differences were T»ot large enough to be of importance especially in view of the 
small riumbers of studerits. 
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Evjaluatidn Report 
Teacher Questionnaire Data, Third Gradg 



. - ' V ■ . 

^ -1977 

^ ' .s ■ 

In Mayf 1977^ a questionnaire was sent^to all third grade teachers of ESMP 
(69 in all). In addition. to the qaestipnnaires , interviews were condwcted with 
32 of the 69 teachers at the three sites where end-of-the^year testing was 
conducted (Kissburi, Georgia and Maine). This report summarizes the responses 
by these third grade teachers to interview and qaestionnaire items. 

The responses are summarized accbrdirig to three areas: Oyerall audgnents, 
Stadent Achievsnent and Mechanical Aspects. 



The responses to the four overall judgmeht questions indicate a definitely 
Favorable attitude towards CSMP although less favorable than in previous grade 
levels, and less favorable than from the previous year's third grade teachers. 

In terms*^ of teachers' opinions about student achievwhent there, are many 
indications that teachers see a need for more emphasis on basic skills. In 
addition almost 2/3 of the teachers felt it was less apprbpriate than their 
previdusly used math program, and this was the second most listed "worst aspect" 
of CSMP. - 

In terms of the mechanical asjDect of the implementation teachers generally 
seemed to be able to cope, with the program; most followed the schedule and 
expected to complete it by the end of the year. 

Finally^ most teachers felt reasonably w^ll prepared for CSMP after their 
trairiirig. ^ . - 
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£v^l^atibh Repidrt 5-B-1 
Fourth Grade HANS Test Data 
: 1978 

This 1977-78 school year, cdristituted the first of two year^ of the Extended 

,. . . ^ 

Pilot Trial (EPT) of CSMP fourth grade materials. 



' . This report describes the results of administering a series of 25 HANS 
Scales to the 9 fourth grade CSMP classes in the St. Louis area and to 8 
comparison classes. 

A general ability test was administered to these classes and the results 
showed the two groups of classes to be nearly equal, but above average in 
ability. Biass mean scores were caicalated for jeach HANS sc^le, and ah Analysis df 
Cbvariance was perfbrmed using the^^j^erai £iiity scores to adjust for any 
differences in ability between the twb groups of classes. 

CSMP classes did significantly Setter^bri all the Number Relationship and 
Large Number Computatibh scales; bri some of the Estimation and ''Bther" scales; 
and on one of the more tfaditibhal Computatibh ihd Wbrd Prbbl«n scal&s. 



Non-CSHP classes did better dh dhly dhe scale^ Cbmput at ibh-Di vision ^ and the 
difference was not significant. When means scdfes for these scajf^^were 
caicalated for students at different ability levels, it was found that when CSMP 



scores were higher over a ll a given scale, they were also higher at each 
ability level. 



3B 
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Evaluatibh Report 5-^-2 
Individually Achtiihistered Problems, Fbarth Grade 

*■,"'■•: . » 

: 1978 • 



By 1977 materials through fourth grade had been developed and the 1977^78 
school year constituted the first of two years of the External Pilot Test (EPT) 
for fourth grade materials with 36 fourth grade CSMP classes located in 16 
school districts. Three kinds of tests were Used: standardized tests (given 
routinely by the school districts), the MANS Scales (Mathanatics Applied to 
Novel Situations, see Evaluation Report 5*B-1), and the individually 
administered problems of this report. 

A series of 6 problan exercises was individually administered to samples 
of 6 students in CSMP and Nbn-CSMP classes in 3 school districts in the St. 
toais area. Three of the exercises were administered to students in 9 CSMP and 
9 Non-eSMP classes; the other three exercises were adininisterd to eitheribr 5 
pairs biW classes. ■ ; ? ," 



9 



On two of the scales, iSuess^ 24 and Blocks of Squares . CSMP classes 
had significantly higher scores than did Nbri-CSHP classes. 9n one other scale. 
Mental Arithmetic. CSMP students had scores about 0.4 standard deviation 
highpr than Nbn-CSMP studentsTl^ut the, dif ferences did riot reach significance, in 
the subsequerit arialysis of class means. On the three r^airiirig scales the 
differences betweeri CSMP and Non-CSRP students were small arid did riot approach 
significance. , 
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Evaltiatibri Report 5-G-1 
Teacher Questiohhaire and Interview Oata^ Tourth Grade 

1978 

In Hay^ 1977 a questiohhaire was sent to all Fourth grade teachers bf CSHP 
(42 in all). Ih addition^ irVterviews Were conducted with a number bf thbse 
teachers. Altogether^ 34 teachers respbhded tb at least sbme bf these questibhs^ 
either ih ah interview br bh a questionnaire. This report summarizes the teacher 
responses tb these questionnaires and interviews. 



\^ The summary data arts basisd bh cdmbihihg all responses, whether from 
tq^chers of veteran classes or of entry ciassiss, and whether received from a 
questionnaire or from an interview. Many of the questions have been asked on 
previous questionnaires or interviews_^(at lower grade levels). This year's 
responses are generally similar, but comparative data is shown were possible. 



the data is summarized in two sections: responses having tb do with the 
way the program was implemehted and responses having to db with teachers* 
judgments about the quality bf the prbgran. 

Mbst teachers received at least 20 hours bf training and generally # 
satisfied with it, used 45-60 minutes per ^ay in math ihstructibh with C5MP, and 

y >■ ■ 

supplemented it wit^ ^fesic arithmetic dpenatidhs and facts. 

Teachers were generally positive in their evaluation of 6SMP^ but on nearly 
every question major criticisms were made by a few teachers. 
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vaiuitibh Report iS-B-l 
Comparative Test Data: Fourth Grade 
1978 



At the end of the 1978-79 school year, a series of testg was administered 
to 30 fourth grade CS«P classes and to 21 comparable Non-CSMP classes. 

• Altogether 9 school districts were invblved, in various geographic 
locations and various sbcio-ecbhomic levels. i * 

The tests used to compare the two groups were the StahTord Achievement 
Bompatation Test and the HANS tests, a series of 24 short test scales intended 
to assess some of the underlying mathematical processes of the C^t^P program. The 
Stanford Achievanent Reading Comprehension Test was used as a statistical 
control for the small differences in ability between the two groups. 

Class means were calculated fcir^ each scale and an Analysis of Covariance 
procedure, with reading as covariateShd class mean as the unit of analysis, was 
used to compare the two groups of classes. 

These findings were consistent with results from other grade levels ^ in 
other, years and at other sites, namely that a) CSMP students do bet^ter with 
number relationships, estimation, certain kinds of word psbblems arid 
fractions/decimals/negative riumbers and b) there are, no differences iri geometry^ 
place value, simple word prbblems arid bverall computational skills. 
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Evaluation Report 6-B-2 
Preliminary Test Data: Fifth Grade 



1979 s ^ 



This is a report df the first year of a two-year evaluatidh of the fifth 

_____ _ • _ _9 

grade materials of the Eomprehensive School Mathematics Progrsn (CSMP). In 
preparation for next year's fall- scale evaluation of fifth grade, some student 
achievement scales were administered to a small group of St. Louis area classes, 
both CSMP and Non-CSMP. The -study was intended to be both a pilot test of 
certairi scales which might be revised for next year, and a preliminary 
comparative evaluation of GSHP/Non-CSMP achievement. 

Briefly the main results are as Tollows: 

1. There tended to bis significant differences in favor of CSMP classes oh 
scales dealing with mental arithmetic, number relations, number sysj^^s 
(other than whole numbers), cisrtaih word problems and problems with ' 



multiple correct answers. 



2. There tertded to be no significant differences on scales dealing with 
standard computation, geometry, probability and place value. 

3. Similar results were bbtai^:^^* when CSMP-Non-CSMP compDarisdns were made 



at different levels, of reading ability arid by sex. 



4i The above results are very consistent with previous findings, particularly 
these obtained in a large scale comparison of fourth grade classes. (See 
Evaluation Report 6-B-1). 



i Evalbation Report 6-0-1 

Teacher Questionnaire Data: Grades 3-5 
^ 1979 

In the SjDrihg of 1979, qaestionnaires were sent to all 158 teachers of 
thirdj fourth arid fifth grade CSMP. 

' { 

Implemeritatibri of C5MP 

1. About half of the teachers received the prescribed training. 

2. About 1/3 of the teachers were speridirig more time than they did 
with their previous curriculum. 

3. Almost all of the fifth grade teachers expected to complete most 
of the schedule of lessons while about BOS of the third and fourth 
grade teachers expiscted to do this. 

4. About 2/3 of the teachers dccasidrially repeated or exterided lessons and 
about half said they omitted some lessons. 



5. ^i^^P^t ail teachers suppl^iented the program in some way, Usually with 
computational practice. 

6. Most teachers would like to see tests built into the instruct ibhal 
materials. 



Evaluation of C5MP 



In summary^ most teachers seemed to implemerit the program in a reasonable 
way, with fairly ribrmal adaptations. And, although criticism was expressed 
cdhcernirig the related issUes of cbmpUtatidrial skill development and some 
problems with low ability stUderits^ it is clearthat a great majority of 
teachers had favorable overall reactibris tb CSMP. 

• . ; 
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Evaluation Report 7-B-1 
Fifth Grade Evaluation: Volume 1, Summary 

198Q 

In the spring of 1989, a series of mathematics tests was administered to 31 
fifth grade classes using the Oomprehensive School Mathematics Program and to 
25 comparison classes using more traditional prograSii In addition to the 
testing^ considerable information was collected regarding teacher and student 
attitudes and implemeritatibh of the program. 



A summary of all the results is given in this volume which is Volume I 

— ■ — - ~ _ _ _ _ 

(Evaluation Report 7-B-1 ) of a three-volume set. Volume II (Evaluation Report 



7^B^2) descfibiss in distail the tests and results of the testing and Volume III 
(Evaluation Report 7-8-3) disscribiss attitudihal arid ijnplemehtatibh data and 
their relationship to the test data. 



45 
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. Evaluation Report 7-B-2 
FiFth Grade Evalaation: Volume II, Test Data ; 

1980 

■ • / i 

In the spring of 1980, a series of mathematics' achievonent tests were 
administered to 31 CSHP fifth grade classes and, to 25 comparison classes. 

The main finding in this study is that ESMP classes, as they have in 
comparative studies at lower grade levels, demonstrate a clear superiority over 
Non-CSMP classes in many of the areas of mathanatical -thinking assessed by the 
MANS tests. In particular, this Was true about: aspects of cbmput at ion other 
than the exact answers using the classic algorithms; the production of multiple 



answers to problans; and discovering and using mathematical patterns and 

functional relationships. In addition, they had significantly higher scores in 

the three areas ^ich receive^ncreasing emphasis in the upper elementary 

^ _ . _ 

grades, nanely: fractions, decimals, and negative numbers. These gains were ^ 

made without any corresponding decrease in scares on the more traditional areas 

of instruction: word problems and computation. : ' 



Item analysis data and different methods of analysis (using class, school 
and district means) cbhfirmed' these general results, though for some. tests 
the advantage for CSMP studer^ was smaller or non-existent for students at the 
lowest reading level . . 



V 



ERIC 



1 



Evaluation RefDort 
Fifth Grade Evaluation: Volume III, Non-Test Data 

198D 



This report describes hbhrtest data collected Frbfri the classes the testing 
of which was reported in This nbh-test data includes information on 

implementation, teacher attitudes arid student attitudes. 

Teacher reactiori to CSMP was favorable^ arid it was more favorable than was 
the reaction of Ndh-CSMP teachers tg their jjarticular program. Two related 
criticisms of the curriculurn by CSHP teachers stb(/d but abbve all others, 
^i^st, many teachers consider the program iriapprbpriate_iri some ways for low 
ability studefits. Second, most teachers think that CSMP does riot provide 
^D°^9^ praptite in computation' skills, which hp dbubt accburits Tor the great 
amount of computational practice they add to the curriculum. 

•i. gorisiderable supplonenting of the CSHP^urriculum pccurred; ari average bf 
^^fe.^r.'Df ^'^_tinie was spent on activitiejK^ Tidt in the "official" curriculum. 
This percent was about the same as for Ndri-CSMP teachers, but rof_those 
teachers supplementing activities were quite varied whereas for CSMP it was 
almost Always computation practice. 



^^rrom correlational data, teachers^ approval of C (using many different 
criteria) was associated with more "game" playing in class^ less homework, more 
teacher training and less supplementing. This is. not a surprising result ; 
these characteristics may be thought of as indicating a^m faithful version 
bf CSMP in the classroom. Furthermore, these same charactfe)ristics are 
associated with higher scores in CSMP-^oriented tests and lower scores in 
cbiiiputatibrially-brieri^^ tests. . 

Teachers were asked tb rate the importance of jthe goal being tested by each 
of the scales used in this year's testing. For all scales the mean rating was 
above the medium rankingy with cbmputa f^ighest arid prjobabiiity 

/lowest. There was very little difference iri the mean ratings of CSMP arid 
Ndri^CSMP teachers. : / . 

y?irig 3 29 item attitude measure, 7 attitude scales were cbristructed. 

Generally, CSMP and, Non-CSMP classes* attitudes. didri' t differ except that CSMP 
classes liked math less, compared to other subjects, than did Nbri-CSMP classes/ 
but saw math as more open. » , ' 



Evaiaation Report 7-B-4 
^ Re-evaluatibn of Second Grade, Revised MANS Tests 

^ 1980 

This study compared CSMP and Non-eSMP stadints' perfdrffiance at tvib siteS . 
asing a streamlined revision of the HANS Tests (Mathematics Applied to Novel 
Situations, intended to assess some of the pnderiying thinking, skills of the 
esRP cprriculun without using any of its special vocabp.lary). A total of 21 
Classes were tested, 12 CSMP and 9 Non-CSMP. The ESMP classes had studied the 
revised version of the CSMP curriculum. 

' 3 / ■ ' • : 

On the total ^of the MANS Scales, CSHP classes averaged about 15% higher 
-scores than , Non-ESMP, a difference which was significant at the ;6l level. 
• ■ ' ' , . , . ' ■ ' ' . ■ - 

On seven of the 13 individual scales, CSMP classes scored significantly i 
higher at the,. 05 levei. Their best performance was in scales dealing with 
nifnber relationships, rnentai arithmetic and number fluency.' They did slightly 
better in estimation and word problem^. There was no difference in cpmputaticin 
scores. ^ ' ■ ' r 

These findings cbrrbbbrate the findings from the more extensive. Sfeended 
Pilot Test, conducted prior to revisions, except that there were l^TgeflPMP 

, V __ _ _ _ _ _ _ ■ „ ■' ■ 

advantages in two of the individual scales. The Findings are ais5 -natlWorthy 
becaua^ the simplification of the testing procedures should make it easier for 
other districts to use these tests which remain^ nevertheless, powerfai enough 
to show various cognitive effects of the CSMP curriculum. 



Evaluation Report 7-B-5 
Achievement of Former CSMP students at Fourth Grade 

1980 

A cdniparisdn of student achievement at the end of fourth grade on the MANS 
Scales was conducted in a district where CSMP was taught only in grades 
after which the district's ^gular prbgran was used. These "CSMP" classes were 
compared with Non-CSMP students who had nd'^evious CSMP experience. Except 
forxthis difference, the study was identical to one conducted a year earlier in 



which! the CSMP classes had, in fact, studied CSMP from K-4. 

The CSMP classes had significantly higher scores than Non-CSMP classes, at 
the .65 level, on nine scales: 

2 of the 6 Computation scales 

3 of the 5 Estimation scales 

2 of the 5iNEiftiber RelatibnsHip scales 
1 of the 3! Other Number System scales ^ 
• 1 of the 2; Place Value scales 

□ri no scale was there a significant difference in favor of the Nbri-CSMP 

classes. Overall^ the mean score across the 24 scales was 136.7 for the CSMP 

- ^ J- - - - - 

classes versus 118.4 for thfr^Ndh-CSMP classes, a ^3% difference which must be 
cdhsidered significant, educationally as well as statistically. 

Surprisingly, (since these CSMP classes had been away frtiti CSMP for a 
year), the data were strikingly similar to the data obtained in a previous 

if 

■ _ *_ ."^ 

large study in which the CSMP classes had studied ESMP through Fourth grade; 



The exceptions werfe: a) the 5 scales dealing with number relationships and 

% ■ 

I : 

scale on decimals, in each of which the CSMP advantage w%s about half what it 
was previously^ arid b) the standardized coaiputatiori test^ where CSMP classes 
did about' 1D5o better than Nbri-CSHP classes^ a fif^ihg exactly the reverse of 
what happeried previously. 

' ■ 49 
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Evaluation Report 7-B-5 * 
Student Achievemeht ^ Rapid Implementation Model 

198D ^ 



Two schools, one in a large Southern city and_the other in a fifjediuni size'd 
Midwestern sut>urb, began using The CcMnprehensive Schbal^Mathefiiatics Progran 
(eSMP) in fall of 197B. At that time CSMP was begun wi^h all students through 
fourth grade rather than the more cdmrndh gbade-by-grade approach beginning only 
in first grade. 

A series of tests was admiriijstered in the spring of •1978, 197? and 1980^ 
The purpose was to compare, at grades 2-4, the perfdrmahce of students: beTore 
the introdcjction of CSMP (197B), after one year of CSMP (1979) and after two 
years' experiencie with CSMP (i9BD). 



1. iSn the HWNS tests, a ^eries of tests designed to assess some of the under- 
lying processes of CSMP without using any of the special terminology or 
problem situations ^f the curricalum^ there was from 197B to 19BD - 
significant improvement at every grade level and this improvemen was 
very consistent with CSMP-Non-CSMP comparisons made? previously with the 

r same tests, J 

^ 

2. At second grade this improvement took place in the first year, from 1978 
to 19^79, with no rurther change from 1979 tq 1986^ At third and fourth 
grades, there were niodest gains the first year and further gains the 
second year. ; 

3. The Rinds of tests on which the 198D students did relatively best - number 
relationships, mental arithmetic ahd estimatibn - we're also the ones for 
which there had been a demonstrated CSMP superiority in fDrevibus 

, studies • • 

^* On standardized tests, at secdnd gradej there was virtually hp change at 
either school in math scores relative to reading scores. At third and 
fourth grades there was usually a small decrease in the first year of 
CSMP followed by a more-than-Cdmpensating gain the secdrid yearj scores 
on the Concepts tests always increased relative td Cdmputatidn scdres. 
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Evaluation Report 8-B-1 
Sixth Grade Evaluatibrii Preliminarj^ Study 

1981 ' 

In the spring of 1982 ah Extended Pilot Test will be coriducted in several 
school district which use CSHP through si^th grade. In fDreparatidn for this 
evaluation study, several MANS scales were developed and tried out in the 
spring of 1981- In addition^ several scales used the previous year in fifth 
grade were retested with sixth graders in 1981 • This report presents prelim- 
inary evaluation data from two very difTereht school districts arid statistical 
data from the trydut of these scales. 

____ _ __ __ __ ___ 

With regard to the preliminary evaluatidh data, even though the number of 



classes tested was low and not particularly representative, CSMP/Non-CSMP 
differences in student achievement were very similar to those found in 
previous studies. • - 

The statistical data on the new scales being trie^oat indicated that in, 
most 'categories^ scales used previous grade levels performed well. As for the 
brarid new scales^ as usual ^ some performed well enough to be considered as 
revisable "candidates for Use in the larger-scale study qf. sixth grade student 
achievement next year. Some scales perrormed go poorly that they would most 
likely be replaced. 

Note: Appendices A and B, which constitute the bulk of this report, appears 
only in the version of the report whicti is bound separately. They do 
not appear in the version with the other reports in the series. 
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Evaiaat ion Report 8-B^2 
Evaluation of Revised Second Grade, MANS Blue Lev-el 

, 1981 

I '.V. * ; ■. '■ 

y ' ■ ■ ' 

— ■ __ ' ^ ' 

This report 'is ah extension of Evaiaation Report 7-B-4, Re-evaluation oP 

Sernnd Grade y^evised MANS Tests . The revised second grade MANS tests (called 

the Blue Level) were Turther revised after their initial use in 198D. the 

^ revisions were minor and still ^ithin the original purpose: to make the tests 

easier for local districts to use. In the Spring of .1981. the revis;|d Blue 

Level MANS tests were ac*nihistered to 20 CSMP and 20 Non-CSMP classes. The 

classes came from five rather^distinctly different school district, but the 

majority were composed of lower ability students. j 

The primary 5bjedtive of the further revisiori- of t+ie. MANS Blue Level was 



judged to have been met: school districts are able to use the tests with 
essentially no problSns. /secondary objectiv'e was toamprove the technical 
quality of the individual scales. For some scales this objective was met, for 
thers it wss.tibt. ' » • 



The CSMP/Non-CSMP' results of the testing were not quite sc^trongly in 
favor of CSMP as they had been in 1980. Nevertjieless , on the total of the MANS 
scales, esMP classes averaged over IDS higher sc5fes than Non-CSMP, a ^ 
difference than wis significant at the .05 level. , in each of the scale 
categories, the CSMP classes dutscbred the Non-CSMP classes, the di-fference 
being statistically signi^cant in one of them: Number Pitterns and 
Relationships. i : 'i. 



Evaiaatlon Report 8-B-3 
Evaiaation of Revised Third Grade, MANS Green tevei ; 

1981 

■ ' ■.,>■ ' - . • ^ 

This study cboipared CSMP and Non-CSMP students' perfbrniarice at two sites 

_ ■ " _ *^ _ _ 

using a streamlined revision of the MANS Tests (Mathematics Applied to Novel 

Situations, intended to assess some of the underlying thinking Skills of the 

CSMP curriculum without using any of its special vocabulary). A total of 18 

classes were tested, ID CSMP and 8 Non-CSMP. The CSMP classes had studied the 

revised version of the CSMP curriculuni. 

Oh the total of the MANS Scales , CSMP classes averaged abbUt ^9% higher 
scores than Noh-CSMP> a difference which was significant at the .01 level. 

On ten of the fifteen individual scales, CSMP classes scored significantly 

higher at the s05 level, five of those ten a the .01 level. Their best 

^ \ - . 

performance was in scales dealing with number patterns and relationships, 

mental arithmetic, estimation, and word problems, ^followed by place value and 

negative' numbers . ;^ 

These findings corroborate the findings from th§ more extensive Extended 
Pilot Test, conducted prior to the revisions. The findings are also 
noteworthy because the simplif icatibh of the testing procedures makes the 
tests easier for other districts to Use and still leaves the scales powerful 
ehbUgh tb shbw varibUs cognitive effects of the CSMP curriculum. 
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E^luatidri Report 8-B-4 
Ihree Evaluations of Gifted Stadent Use * 
1 981 

The Comprehensive School Mathematics Program (CSMP) has been developed as a 
K-6 curriculum in mathematics for ordinary classroom use. Nevertheless, during, 
the last two or three yeara, school districts have begun to use CSMP for 
elementary school students identified as well above average in iiiity: 
gifted, upper track, etc. in the 1980^81 school year, three districti did this 
and also carried out kind of testing program to evaluate student oabcomes.: 



Each district had a somewhat different student identification procedure, a 
different type of utilization of eSMP and a different evaluation design, it is 
instructive to characterize the differences between the three and standardize 
the results so that cdmparisons can be made. In each site (district) the 
student achievement was measured using the MANS t^sts. 

In terms of Total MANS scdre^ excefDt in fourth grdde at Site 1, CSMP 

._ ■* ____ -V'-l ■ ^ 

outscored Non^ESMP at every one of three grade level^iafc every site. , < 



In terms of the six main MANS scale categories there is considerable 
variation in the results depending on the category of scale. Whereas the ESMP 
advantage is relatively weak in eortputa^ii^r^,/,NMmbe Patterns 5 Relationships, 
and Word Problems, it is strong in Estimation and Other Number Systems 
(fractions and decimals), and very strong in Probability. 
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Evaluation Report 8-6-1 
Prelimihiry Study of eSMP "Graduates" 
1981 



One of the most import arit questlb^ in the evaluation of CSUP is the 
ability of eSMP students to learn and do mathematics after they have completed 
the CSMP R-.6 progran and are enrolled in a "regular" mathOTatics program. 



The present study is a preliminary investigation of one aspect of this 
question, a comparison of seventh grade math teachers' ratings of former eSMP 
versus former Non-ESMP students* perfdrmance in class. 

The data are Far from definitive, but Ex-CSMP students seem to be doing at 

least as well in their seventh grade math classes as Ex^Ndh-CSMP students '>^n 
ability is controlled, and often they do better. S 
• . - 4 

At two of thpee sites^ Ex-CSHP students received higher teacher ratings for 
Participation in Class, Mbtivatibh^ Creativity and Problem Solving, and 
Practical Applications; this advantage wa? usually significant in one of the 
sites, consistent but not quite significant at the other. At the third site, 
there were no differences between Ex-CSHP and Ex-Nbh-CSMP student^ 

Further analysii at one of the sites shbwed that Ex-CSMP students received 
significantly higher grades in mathematics, especially those In the middle 
ability ranges. Interviews with seventh grade Jtiath teachers at a fburth site, where CS 
Nbn-CSHP comparisons were not possible, confined the view that CSMP students 
had fid difficulty in adapting to the usuai classroom activities df seventh^ 
grade, and were in some ways, better students i 



Evaluation Report 
Sommary of Student Achievement Data, Draft Report 

1982 



This draft report and draft report will be revised into a Singi 

Comprehensive Summary of ESMP. V 
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Evaluation Report 
C Sumnary of Implementation Oata^, Draft Report 

1982 

* 

This draft report and draft report , will be revised into a Single 

Eomprehensive Summary of ESMP. 
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Evaluatidh Report 94B-1 
-- Sixth Grade MANS Test Data ' 

1982 

In the spring of 1982, a comparison study of student achievement was 
conducted, comparing 26 sixth grade CSMP classes with 37 Non-CSMP classes. 
This study was the Final one of the CSMP Extended Pilot Test, in which at 
successively higher grade levels, ESMP and Non-CSHP performance was compared. 
Altogether, 10 school districts were represented in the present study. CSMP and 
Non-CSMP classes were similar in overall ability, both groups being well above 
average. 

The tests used for the comparison were the MANS Tests. An analysis of 
covariance procedure on the class meSns was used, with a built-in Vocabulary 
test serving as a covariate. The main results of this comparison of class 
means were the following.: 

I 

□n the Total of MANS Tests, CSMP classes had higher scores 
(statistically significant at the .01 level)', about 10S higher than 
Nbn-CSMP classes. 

the 12 mathematics categories into which the MANS Tests are divided, 
CSMP classes had sigrfificantly higher scares (p < .01) in 8 of'them.; 
Among the categories p'rbaucihg Iktge differences in favor of CSMP were 
those dealing with estimation, mental arithmetic, number patterns, 
prodaction of multiple answers, and algebraiS processes. • 

Dri brie category. Geometry, consisting of a single test, Non-CSMP 
classes had significantly higher scares (p < .05) 
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Evalaatton Report 9-6-1 ' . 

~ _ ~ V ^ 

Sixth Grade Evaluation: Teacher Qaestiohnaires 



1982 




This_repbrt_ describes ribri-test data collected from the classes tested in 
report 9-B-1 ihcludihg impl«neritatibri data and teacher attitodesi 

Irnplemehtatibh 



\ 



Both CSMP arid Nbh-CSHP teachers: were quite experienced teachers; 
averaged betweeri 50-55 mirilites of math time daily^ arid sup(Dl«Tierited their 
respective math programs about equally (14S_bf the time) though CSMP 
sdpplemeritatiori was generally cdmpUtatibrially brierited versus "eririchmerit". 
oriented for Ndn-CSMP teachers. CSMP teachers spent mbre time_bri_ teacher-led 
work arid less on individual arid anall group wbrk than did Nbri-CSMP teachers. 
As a group (CSMP teachers were more dfteri likely to fbllbw lesson plans iri 
greater detail, think the lessori cdhterits more challerigirig arid view math class 
?s 'note "fun", drierited tdward creative activities arid drie df thre easier 
subject to teach than their Ndn-CSMP couriterparts. 

Teacher Attitudes r 

CSMP teachers gave h i gher rating to their program on overall quality, 
student interest and invoiyemerit, CO ability to do logical 

reasoning and word problems, and appropriateness for high ability students than 
did Non-6SMP teachers. £SMP teachers gave Jtxawer ratings on computation 
achievement and apprbpriateness for lower ability students. 



Overall Evaluation 



The vast majbrity of CSMP teachers gave highly ^favorable evaltiatioris of 
the (Drbgran althbugh some teacher^ thought it worked better with high or 
average ability students thari it did with low ability students. An often cited 
strong pbirit was its impact on students' thirikirig. Nbri-CSMP teachers^ bri the 
other harid, while g^firally satisfied v^ith their programs^ stated that it was 
adequate blit cited thfe rieed fbr sUppl«rieritary eririchmerit. 
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Cooperative Research Stady 
Bedford, Michigan 
1981 



MANS teats were adninistered only at second grade dae to their being - 
'^anaviilable below grade two and due to the imcomplete implenientation of the 
CSMP program in grade three. AH the second graders in the school using CSMP 
were tested as were. all the second graders in a comparable schooi not using 
CSMP. 



Bedford, Michigan, is a middle class suburb of Tbledb, Ohio, which is just 
across the state line. Bedford Public Schools has four elementary school's, one 
of which used eSMP informally with one teacher in 1979-80 Shd rormally wlt^ 
most of the teachers k-3 iiy 1980-81. " j 

Due to the small number of classes involved, the less conservative Uri^t 
(student) was used as the unit of analysis, (of the results). On overall 
perfoi-marlce, Bedford CSMP students had ah advantage that was statistically 
significant. This was also true for four of the seven MANS categories. 

. Compared to similar studies of second grades at other sites, the 5ver-all 
results in Bedford are much the same. There are a few differences at the 
category level. The Bedrord CSMP students are relatively stronger in 
Computation and weaker in Estimation than CSMP students elsewhere. 
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Cooperative Research Study 
Detroit , Michigan 
' 1981 



The Detroit Public Schools began using CSMP in a relatively small number 
of classes in grades K-l in 1972. In 1979, money became available to begin a 
full scale impiefnentation of ESMP. ^During tHteit first year of impi^entation 



there were the usual start-dp probieiifs - one might anticipate, with this large 

- -- -- . V ■. • - ^ . ^. t. 

number of classes. , ' ' - ^ * 

By the aecohd year, ESMP was more stabilized in these schools^ though 

several implement at ibri problems renvairi. In order to assess thfe progress of 

- . S _______ . _ 

students in CSMP^ a joint evaluation study was tohducted .by CEHREL and the ; 



Detroit Public Schools^ comparing 10 CSMP and 10 comparable Nbh-CSMP secbpd 

; Us 



grade classes. The HANS test arid the Math Score of the CAT were Used to 

>• ' __ _ . ■ ■ _ . " __ _ ■ 

compare the perfdrmarice of the two groups of classes. 



The CSMP classes had a higher total MANS score that Non-CSMP classes, but 
the difference was not statistically significant, the Non-CSMP classes had a 
small, bat not significant advantage on the CAT Total Math; 

/ 

The MANS performance of both CSMP arid Nbri-feSMP classes iri Detroit is c|uite< 

- _ . __ *f_ ""'* ■ _ _ _ _ — ' 

gqod, and "pt ^least as high ;as the cbrr^esporidirig CSMP arid ^Nbri-CSMP classes in 

the other districts. This is ribt surprising since both groups of teachers were 

known to be ^brig the better teachers. 
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Cooperative Research Study 
Grihnell-Newbarg, Iowa 
1981 



Droximately 40 atuderits in Gririhell participated in- the secdhd 
through-foarth-grade pa^ of gifted mudent program in mathematics; the grade- 
level at which this evaluation study *yas conducted.'' It was the initial use oF 
C5f1P iri (irinppil;,,th^ supplemerited the regular math program Tor about 

'f5S-2DS oF the time.- ^ 



At each grade level, ecores on the HANS tests administlftd at the end of 
the 1980-81 year, w&re compared with scores From the previoas year for ilmilar 
students in the same grade who- had flot had CSHP. MANS scores increased at 
grades two and three by 1 0S and 1% respectively but declined at fourth, grade by 



Previous studies in »»hich CSMP has been started at all grade levels the 
same year (ratlier than orie-year-at-a-time) have sh^wn that the greatest 
benefits daring the first year oF the prograS occur for second graders; Fourth 
..graders take another year beFxire reaching the level oF similar "experienced" 
CSMP Indents. However, no previous studies have shown declines in MANS 
score^. Furthermore the pattern oF gains and losses on individual MANS tests 
was rather diFFerehfc: From previous studies. , 




Several Factors make this study less thati ideal, not the- least oF which is 
the small number oF students, the process of selection for testing, and the 
differences in test adniriistration where the'role of the tester is crucial 
because of the novel nature of the tests. 
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Cooperative, Research study 
Harrisonviiie, Missouri - 

1981 ; " 

Approximately AO studeqts in grades 2-6 participated in the Harrisonviile 
School Eristrict program for gifted students. Part of the instruction involved 
the use of materials from the -Comprehensive Schobl MatHematics Program. These 
students were pretested in SeptefSb^r and pbst-fe^sted in Ray; the tests: used 

• __ __ *_ 1 ~__ __ 1_ 

were the HANS tests, a specifil series of tests developed to assess some of the 
underlying thinking skills of CSMP without using any of its special terminblb^ 
or techiniques, ^ 



Jhe^v&XBge percent gaihs^ acrbss the various subtests, were 64^, 22% and 
9% for grades ^2-4 combined, fifth arid sixth respectively. 

^ " ' • r . ^^^^ 

' The gain for second through fourth graders was very high and fpr exceeded 

. ._* . _ __ ' _ J* '■ ._ 

results frcwi preivious studies comparing CSMP and non-ESMP^-students , as did the 

gains for fifth graders* For sixth graders, the lower gains can be at lea^t; 

partly explained by the ceiling effect; on most of the scales^ the mean scbre 

on^ j^fte- p^t^t was at least 86^ leaving little: room for imprbvemerit . / 



The pattern bf gains was usually similar tb the pattern bf CSMP-ribri-CSMP* 

differences obtained in previous studies (with^sbme exceptibris rioted iri this * 

_' _ _ _ _ _ 

report). Scales bri which sigriificarit differerices had pr^idUsly' been found 

_ . _ _ _ ' . : 

tended to produce the largest g^iri iri the preserit study. 



S3 



Jariesyille, Wiscons^ 
Impl«nentation Study 
1981 



The 3anesville (Wl) Public Schools adopt^he ase of CSMP with the upper 
(^4 to 1/2) track classes. In 1^80^81, approx lately half the teachers of 
thW. classes (K-6) choSe to use the program. Si&e this is a unique kind of 



implementation for ESMP^ a site visit was arranged for May of this school year. 



This, is a report of that visit; 



Giv^ri the particuii? method of implemeritatibri th'fr ':3arie8ville adoption 
appWs to be exanplary; it has gotten off to a very good at ^rt and appears to 
have excellent prospects for . future continuation. State" ruriding Appears t6 be 
continuous. Even the second rourKj.of (mostly nDn-volUhte^r) teaches have been 
brought around from largely a negative attitude to a largely positive one. 
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Cddperative Research Study 
Oanesville,Wiscdnsin Testing 
1981 

• __: A 

During 1980-81, the Oanesville Public Schools began the use of the CSMP 
math progrsn with about half of its upper ability elementary school classes. 
Due to the unusual nature of this adoption, a rather intensive evaiaation of 
students performance was carried out in grades 2 through 4. Tests used in the 

usual CSMP evaluation studies were given to 11 eSMP and 10 comparable Ndri-eSMP 

_^ 9_ _ ; ___ ___ __ __ " 

classes in May. The tests included both standard computatibh and a number of 

MANS scales developed to test the effectiveness of the CS^P program. 

TKe results of the testing showed the. Jahesville CSMP classes 
but-perfbrmihg their Nbn-CSMP cburiterjDarts in much the sane mahher as has been 
found. in other settings. In sjDite af the fact that the Oahesvilie findings are 
quite positive in favor of CSMP^ the reader is fefflinded that the study was done 
oh a relatively small number of classes,' with teachers who volunteered to use 

■ _• / , \ 'V ' ■ ' y -■. 

the new program. 



r 
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* . Gbpperative Research Stady 

" i 's -1* Ladue, Missouri 
^. 1981 



The Ladue (MO) Public Schools hW^)eeh using CSMP For several years, 
implenenting it one grade level per Uar "wiith about half the classes. In * 
1980-81 for the second time, there were sixth grade CSMP classes in two of the 
schools. 

A serifes of tests was administered to the 6 sixth grade CSMP' classes and 6 
Non-eSMP classes. The study was a foilow-up to a study conducted last year in ' 
fifth grade with many of the same students, though many of the individual 
scales were Being used Tor the first time. Hence the study served the dual 
purpose of a preiimingry assessment of CSMP sixth graders and a pilot trial of 
hew HANS scales. ' 

CSMP classes had significantly higher total »m scores than Non-CSMP 
classes^vyheh readi^ig scores were used' as a statistical control for ability 



\ 

level of classes. 



Also ihtervi^s vyere conducted with 30 sixth §rSde students in or^er ^o - 



assess students ^^Uhderstanding of the WANS scales and their metfidds of 
attempting tfjem. Two hevy tasRs vyere also tried. The iht"er.views vyeVe^pPimariiy 
developmental in nature and did not lend themselves to statistical aggregation 
but,, generally, CSMP students showed slightly more sophistication in their 



homericlatore and ease of solutidh. 



BB 
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Cooperative Research Study . * 

New Orleans I Lbusiana 

1981 . • . ' . 

the 'MANS tests were administered to secohdi third, and sixth grfiide GSMP 

and Ndn-CSMP classes in New Orleans. At each grade level a sniall number of 
clasises (7 to, 9) was tested. > * 



In second grjade, CSMP classes had higher mean 'scores than Nbn-CSHP classes 
on each of the*/ MANS categories. The scores on Total MANS were 52.7 for CSHP 
and 44.9 for Non-CSMP, but this difference was significant at only the .2 
level. , ^ ^ 



in third grade,' GSMP classes had higher mean scores on 6 of the 7 
categories. The scores on Total MANS were 66.7 for ESMP and 63.4 for Non-CSMP; 
a difference which did not even approach significances 

In sixth grade ^ CSMP had higher scores on all 9 MANS categories, 
significantly so in 4 of them, the total MAf|| scores were 154.7 for CSMP and - 
127.2 for Nbh-CSMP. Even this large a diffferehce was significant at only the 
.07 level. 



The small number of classes and degrees-of-freedom limit tjie 

^ _■ __ _ :_ I _ _ __ 

interpretation of the results, from a statistical^ and sanpling point of view. 
Statistically, a large difference between ESMP and Non-ESMP scores is required 
before significance is achieved. Teachers were not randomly assigned and there 
is rib adequate way to determine the cbmparability of the ESMP and the Non-ESMP 
teachers. ^ 

; :v ■ . ^ ■ , . - .,• '. ; • 



Cooperative Research Stcidy ^ . . 

Ann Arbor, Michigan 

1982 ; • t 

In order to compare CSMP and Nbn-CSMP classes in tnathenatics performance a 
special series of teats, the MANS Tests, was actniniatered by socially trained 
testers to all second and third grade classes in Ann Arbor. For the most part 
these teats, m problern solving in nature, and involve mat.heme^cal sltuatidh 
which we re. unfamiliar to both CSMP and Ndh-CSMP students. The testing toafe 
place in May, 1982, and involved a total of 93 classes. . '^ ^ 

___ — ^ / 

The mean Total MANS scores, after adjusting Tor differences In .ability 
(measured by a special vocabulary test), w^re as follows: 

» _ r L" * _ _ , . • ■ . ' . ; 

■ Second Grade: CSMP Classes - 98^2 . ''^^Non^GSMP Classes - 85.6 



f 



Thir^fr Grade: . CSMP ^Classes - 122.8 Non-CSMP Classes - 106.2 



At both grade levels, the CSMP classes had higher scores^ ^y about 15%, and 
this difference was significant at the .01 level on the Analysis of Covpriance 
of class means. ' ■ * , 

in addition to gignificantly higher Jotal scores, , CSMP clases af eacKv 
grade level had higher scores on each of the seven ^ategDries which make' up 
the MANS test. The relatively weakest performance of the CSMP, classes was iri 
the Computation category, arid everi'^there they had higher scores than Ndh-CSMP 
dlasses, though the difference was hot statistically significant. 
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Cbbpe^bive Research Stddy 
* Bronx ^ New York ^ 
1982 

In order to assess the perfSrmance of Non-CSMP classes at P-iS. 71, Bronx, 
New York, a special series of tests, the MANS tests, was admirif stered to 
selected fourth grade Ndn^CSMP clashes. For the most part, these tests are 
problem solving in nature, and involve mathematical situations which were 
unfamiliar to both CSMP and Ndh-CSMP students. The tests were administered by 
a specially trained tester to fduV fourth grade classes in Hay, 198^. 

*' ' ' 

There were no CSMP classes at P.S. 71 so Ndh-CSMP perfbrmahce was compared^ 
to CSMP and Non-ESMP classes in other districts which participated in the 
Spring, 1982 '^NS testing. In each of those larger studies, C^P classes had 
significantly higher scores than/ Non-CSMP classes. In qeneralfffte Bronx 
classes performed like other Nbh-ESMP classes, i.e., their scores were Idwer 
than CSMP c 1 asses . 
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ERIC 



Cdbperative Research Study 

Detroit, Michigan ^ 
' 1982 



cn.oin4 order to compare CSHP and Non-ESMP classes in mathematics performance a 
special sertes of tests, the HANS Tests, was administered by a specially 
trained ^pcl^^>^■ hrs it rcuo i-kj-j _i ^ , i: ,- _i ^ «>■«■■«•/ 



i T lE- =7-: "7'''- r"^ ^ ^"^^c teaLs are proqiem soivina in nature, and 

involve mathematical situations which were unfamiliar to ijth CSHP and^Non-ESHP 
students. -Thes testing took place in Hay, 1982. ■ ana jMon tanr 

after adjusting for diffferenees' in ability . ■ 
Frir Wn'"^?<^«P a special vocabulary test), were 98.3 for CSHP ci'q^es versus 82.5 
for iMon-toMP classes. ' ^ v/ 



iiir^ °f^ 3ignxficance achieved was. .20 on the Anai,^8|fP^cavariance of cliss ^ " . 

TKs th«n ?n °^ '^^^ ^^^9^ ^ diffe^e^:%c6urring by chance^ . ' > ' 

less than .20, or less than once chance in 5. The r^U are highly - = — 

dn^?hI^rkInSs'o?°testsr"''"'"''' ^^°nstrate ^thai: EsSp dlassea^J 3Upe^^^^ 



1 ^v. 



Inspection^of the, graphs of class means reveals tHat the Non-e^ classes 
,Jerfonnang|^Qn the HANS t^st couid be predicted quite well from vocSuiarr^ 
scores, CSHP classes, however, tended to divide into 2 groupe. One group of ' 
about 5 classes performed like Non-CSMP classes in that the WANS scores were 



effect may be due to differences irt teacher ability, or wUiingness, to 
implement the curriculum. - • 
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Cooperative Research Study 
^ Glehdale-River Hills ^ Wisconsin 

' 1982 

CSMP is being used as the only mathematics curriculum in Glehdale-^River 
Hi-lls for grades K-3 and is avail-ablef as a supplement in rbUrth arid fifth 
grades. It was there fdjre hbt'^^pdssi^e to compare, at any grade level, 
mathematics achievement of CSMP and Non-CSMP classes within the district. 
However, at each of these grade levels, comparison studies were being conducted 

at other sites and it was therefore possible to compare Glendale clasps with 

_ . _. ^ » 

those i ^ other districts. ^ ^ 

Since some fourth and fifth grade stadenta in Glendale did have previous 
CSMP experience, it was also possible at these grade levels to compare their . 
perfdrmance with the performance of the other Glendale students .^ The vehicle 
for this evaluation was the MANS tests (Mathematics AfDfDlied to Novel 
Situations) • 

In general , G^hdale^ (CSMP) second and third grade clases performed 
better than comparable Nbh-CSMP clases elsewhere, but hot quite as well as 
comparable CSMP clases at other sites. While the Glendale fourth and fifth 
grade classes performed about as well as comparable classes (taking CSMP and' 
Non-CSMP as a group), analysis at the student level sgPbwed ex-CSMP Hlendaie 
students (as a group) performing as vfeli. as comparab^ CSMP classes elsewhere: _ 
i .e. significantly better than Non-CSMP clases. 

1 



eooperative Research Stu^y 
Globe, Arizona. 



1982 



In 1981-82^ the Comprehensive School Mathematics Prdgran (CSHP) Was being 
used in some K-2 classes in Globe, in May, 1982 a small study was conducted 
to compare two CSHP secon_,fj:,tuade classes and two Non-CSMP second grade classes. 



The vehicle ^*J|ij|^valuation Was the MANS tests (Mathematics Applied to 
Novel Situations). , * . 



•i ; . . ■ • 

' -V^r'^.^ - 



Because there were only two C^^^^^^^^^^-CSMP ciases tested, It was not 
appropriate to make-^at istical • cSfipirisbni^w^ testis etc. 

However, because there were many second gr'ade classes from other participating 
school district, it was possible to analyze the combined perrormance oF^ these 
classes to evaluate th^ performance of* the Globe claies in this context. 



' - r- - __ ______ _ ^* __^- 

Overall^ CSMP cla^e? *had signi ficantly^higher scores than Nbh-CSHP 

classes. However, th6 Globe CSMP Classes do not appear to be doing as well as- 
mgt of the CSMP ciases in other sites, bat aboat^as well as Ndn-CSMP ciases 
sewhere. < ' * '^y' 



^ • . ... 



The Globe Non-CSMP classes performed very much like comparable Non-CSMP 
classes elsewhere " . 



f 



7g 
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Cdoperative Research Stddy 
Hawaii 
1982 



in order to compare GSMP and Non-CSMP classes in math^atics performance a 
special series of tests, the MANS Tests , was administered by a specially 
trained tester to three CSMP second grade c^^sses and to three Ndri-CSMP classes 
in Hawaii, For the most part these tests are problem solving in nature, and 'H^ 
involve mathematical sitaations which were unfamiliar to both CSMP and Ndh^CSMP 
students. The testing took place in May, 1982. 

~ f___ _' L____ 

The mean Total, MANS scores, after adjasting for differences in ability 
(measured by a special vocabulary test), were. as follows: 



Second Gra^g^^ CSMP Classes - 112.0 

Nbn-^CSHP Classes - 93, a > 

In addition to higher Total scores, CSMP classes had equal or higher 
scores on each of the seven categories of mathematics processes which jti^^e Up 
the MANSES ts, and significantly higher scores on four df^them: CdmpUtatidh; 
Estimation; Relationships and Number Patter|R!^; and Word Problems. * 




I- 
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Cooperative Research Study 
•Jahesville^ Wisconsin 



1982 " " 

• - \ 



in orde*^ to assess the performance of CSHP classes in Janesville, a 
special series of tests, the MANS tests, was administered to selected BSHP 
classes in'* grades ^2 - 5. For this most, part, these tests are problem soi\^ing in 
rtatare, and invpive mathematical situations wflich were Unfamiliar to both GSMP 
and Non-ESMP students.* The tests were administered by specially trained 
testers in 15 3anesvilie classes in May, 1982. v 

There were no Non-ESMP classes in 3anesville comparable in ability to 
these high ability CSHP classes. The CSMP performance at each grade level in 
Janesville was therefore compared to CSMP and Non-CSMP classes in other 
districts which participated in MANS testing at the same time daring Spring, 
1982. In each of those larger studies CSMP clases had significantly higher 
scores than Ndh-CSMP clases, and in each of grades 3 - 5 the 3an'esviiie classes 
performed at least as well as other CSMP classes and contributed to the overall 
CSMP advantage. At second grade, the overall Janesville performance was not as 
strong as otheir CSMP closes, but was generally better than comparable Non-CSMP 
classes; . ^ 

The Janesville classes also reflected the strong (and significantly 
higher) CSMP scores in particular categories of mathematical problems, espec- 
ially those dealing withr estimation; mental arithmetic; and number patterns 
and- relationships. They also reflected the overall performance in 
computation in which there were no significant differences at any grade level 
in favor of either CSMP or Ndn-CSMP classes. 



